Instrument semiotics: a semiotic approach to interface components

This paper will briefly present a semiotic approach to instrument interfaces based on a conceptual analysis of displayand control-components and their compositional semantics. Displayand control-components can be considered as prototypical objects that are themselves constructed from combinations of more elementary signs expressed in some combination of media. Different types of signs (or “representational modalities”) and different types of media have different semantic and syntactic properties. These properties will to some extend determine what different combinations of media and signs are good for, i.e. what kind of information can be adequately expressed in a given media-modality combination and what kind of cognitive support, it will give to the social agents using it in a work context. The relevance of such an approach is partly to enhance our understanding of instrument interfaces and Human-Machine Interaction in complex work domains and partly to support the design and development of flexible and tailorable instrument interfaces. This is an extended position paper following the Workshop on Semiotic Approaches to User Interface Design at CHI’2000.